Analysis of images located within three-dimensional environments

ABSTRACT

Images are analyzed within a 3D environment that is generated based on spatial relationships of the images and that allows users to experience the images in the 3D environment. Image analysis may include ranking images based on user viewing information, such as the number of users who have viewed an image and how long an image was viewed. Image analysis may further include analyzing the spatial density of images within a 3D environment to determine points of user interest.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.11/461,315, filed Jul. 31, 2006, the entire disclosure of which ishereby incorporated by reference.

BACKGROUND

Over the past decade, the popularity of digital photography hascontinued to grow exponentially as digital cameras have becomewidespread, whether as stand alone devices or integrated with otherdevices, such as camera phones. At the same time, technologydevelopments have made it easier to share photographs, for example, byemailing digital photographs, posting digital photographs on personalwebpages, or posting digital photographs on photo-sharing websites. As aresult, individuals now have access to millions of photographs. Whilethe general availability of photographs provides exciting opportunities,it is difficult for users to sort through such vast numbers of images.Current approaches for searching through images, such as tagging imageswith keywords, often does not provide a satisfactory user experience.Additionally, current approaches for photograph sharing are fairly dry.Photographs may be sent to a person (e.g., via email) or a site (e.g., apersonal webpage or photo-sharing website) and viewed. It is currentlypossible for users to create more immersive experiences, such as byusing tools to create slideshows of images. However, the result stilltends to be linear (i.e., progression from one image to another) and inlarge files that are hard to share.

Fairly recently, a technique has been proposed for generatingthree-dimensional (3D) environments from two-dimensional (2D) images,such as photographs, and for positioning each of the photographs withinthe 3D environment. The resulting 3D environment may then be navigated,allowing users to view a collection of images using the 3D environmentto provide spatial context. While this technique provides a moreimmersive user experience, the size of a particular 3D environment maymake it difficult to share. Additionally, the 3D environment may becomecluttered if an excessive number of images are included.

BRIEF SUMMARY

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

Embodiments of the present invention relate to applications that extendthe basic concept of determining spatial relationships between imagesand generating a model allowing users to experience the images in a 3Denvironment. Some embodiments relate to ranking images based on userviewing information, such as the number of users who have viewed animage and how long an image was viewed. Other embodiments are directedto analyzing the spatial density of images within a 3D environment.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

The present invention is described in detail below with reference to theattached drawing figures, wherein:

FIG. 1 is a block diagram of an exemplary computing environment suitablefor use in implementing the present invention;

FIGS. 2A and 2B illustrate a collection of photographs and a 3Denvironment generated from the photographs, respectively;

FIG. 3 is a flow diagram showing an exemplary method for creating adocument defining connections between images in a 3D environment, inaccordance with an embodiment of the present invention;

FIG. 4 is a flow diagram showing an exemplary method for ranking images,in accordance with an embodiment of the present invention;

FIG. 5 is a flow diagram showing an exemplary method for determiningpoints of user interest based on the spatial density of imagespositioned in a 3D environment; and

FIG. 6 is a flow diagram showing an exemplary method for navigatingbetween images in webpages and 3D environments, in accordance with anembodiment of the present invention.

DETAILED DESCRIPTION

The subject matter of the present invention is described withspecificity herein to meet statutory requirements. However, thedescription itself is not intended to limit the scope of this patent.Rather, the inventors have contemplated that the claimed subject mattermight also be embodied in other ways, to include different steps orcombinations of steps similar to the ones described in this document, inconjunction with other present or future technologies. Moreover,although the terms “step” and/or “block” may be used herein to connotedifferent elements of methods employed, the terms should not beinterpreted as implying any particular order among or between varioussteps herein disclosed unless and except when the order of individualsteps is explicitly described.

Embodiments of the present invention provide applications that expand onthe basic concept of using a collection of images to generate a 3Denvironment in which the images are positioned based on spatialinformation associated with each image.

Exemplary Operating Environment

Having briefly described an overview of the present invention, anexemplary operating environment in which various aspects of the presentinvention may be implemented is described below in order to provide ageneral context for various aspects of the present invention. Referringinitially to FIG. 1 in particular, an exemplary operating environmentfor implementing embodiments of the present invention is shown anddesignated generally as computing device 100. Computing device 100 isbut one example of a suitable computing environment and is not intendedto suggest any limitation as to the scope of use or functionality of theinvention. Neither should the computing device 100 be interpreted ashaving any dependency or requirement relating to any one or combinationof components illustrated.

The invention may be described in the general context of computer codeor machine-useable instructions, including computer-executableinstructions such as program modules, being executed by a computer orother machine, such as a personal data assistant or other handhelddevice. Generally, program modules including routines, programs,objects, components, data structures, etc., refer to code that performparticular tasks or implement particular abstract data types. Theinvention may be practiced in a variety of system configurations,including hand-held devices, consumer electronics, general-purposecomputers, more specialty computing devices, etc. The invention may alsobe practiced in distributed computing environments where tasks areperformed by remote-processing devices that are linked through acommunications network.

Computing device 100 includes a bus 110 that directly or indirectlycouples the following devices: memory 112, one or more processors 114,one or more presentation components 116, input/output (I/O) ports 118,I/I components 120, and an illustrative power supply 122. Bus 110represents what may be one or more busses (such as an address bus, databus, or combination thereof). Although the various blocks of FIG. 1 areshown with lines for the sake of clarity, in reality, delineatingvarious components is not so clear, and metaphorically, the lines wouldmore accurately be grey and fuzzy. For example, one may consider apresentation component such as a display device to be an I/O component.Also, processors have memory. We recognize that such is the nature ofthe art, and reiterate that the diagram of FIG. 1 is merely illustrativeof an exemplary computing device that can be used in connection with oneor more embodiments of the present invention. Distinction is not madebetween such categories as “workstation,” “server,” “laptop,” “hand-helddevice,” etc., as all are contemplated within the scope of FIG. 1 andreference to “computing device.”

Computing device 100 typically includes a variety of computer-readablemedia. By way of example, and not limitation, computer-readable mediamay comprise Random Access Memory (RAM); Read Only Memory (ROM);Electronically Erasable Programmable Read Only Memory (EEPROM); flashmemory or other memory technologies; CDROM, digital versatile disks(DVD) or other optical or holographic media; magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other medium that can be used to encode and store desiredinformation and be accessed by computing device 100.

Memory 112 includes computer-storage media in the form of volatileand/or nonvolatile memory. The memory may be removable, nonremovable, ora combination thereof. Exemplary hardware devices include solid-statememory, hard drives, optical-disc drives, etc. Computing device 100includes one or more processors that read data from various entitiessuch as memory 112 or I/O components 120. Presentation component(s) 116present data indications to a user or other device. Exemplarypresentation components include a display device, speaker, printingcomponent, vibrating component, etc.

I/O ports 118 allow computing device 100 to be logically coupled toother devices including I/O components 120, some of which may be builtin. Illustrative components include a microphone, joystick, game pad,satellite dish, scanner, printer, wireless device, etc.

Generation of 3-Dimensional Environments from Images

Embodiments of the present invention build upon the underlying techniqueof building three-dimensional environments (3D) from two-dimensional(2D) digital images. Generally, the technique uses a collection ofphotographs located in a geographically contiguous area (e.g., a famoustourist site). These photographs may be a user's personal photographs ormay be obtained for a variety of sources, such as photo-sharing sites.The technique matches the photographs, estimates the relative 3Dpositions of the photographs, and constructs a model of the 3Denvironment. The complexity of the model may vary in differentembodiments and may range from a sparse (point cloud) model to acomplete 3D texture-mapped model. The photographs are positioned withinthe 3D environment based on the spatial information derived for each ofthe photographs. A user may navigate through the 3D environment and thephotographs. Navigating from photograph to photograph maintains the fullrealism of each photograph, and uses the 3D model principally toorganize the photographs spatially and create transitions between themthat preserve their geometric relationships.

An example of a 3D environment created using the above-describedtechnique is illustrated in FIG. 2B. In particular, a collection ofphotographs 202 of the Notre Dame cathedral in Paris, such as thoseshown in FIG. 2A, were used to generate the 3D environment 204 shown inFIG. 2B. The technique determined the 3D locations of the images withinthe collection and generated a sparse 3D model 206, which comprises apoint cloud model of the scene, as shown in FIG. 2B. The images areshown as frusta (e.g., frustum 208) within the 3D environment and arelocated based on their respective 3D locations.

It should be noted that although photographs are most likely the primaryimages that may be used to create and/or are included in such 3Denvironments, a variety of other 2D images may also be employed. Forexample, video images may be included by taking one or more frames ofthe video and positioning the video within the 3D environment based onspatial information associated with the frames. Additionally, artworkimages, such as paintings or sketches, may also be similarly positionedin the 3D environment. As indicated above, the images may be collectedfrom a variety of different sources within the scope of the presentinvention, such as, for example: a user's personal collection;photo-sharing sites; images located within webpages; and live (real-timeor near real-time) feeds from cell phones and web-cams.

While the above-described technique provides a rich way to experiencephotographs in a natural 3D setting, the implications of this work aremuch wider reaching. A wide variety of applications are enabled anddiscussed in detail in the following sections.

Document Creation, Editing, Viewing and Sharing

Although the generation of 3D environments as described hereinaboveprovides a rich user experience by allowing users to view 2D images,such as photographs, within a 3D scene that organizes the imagesspatially, the user experience could be further enhanced. In particular,the availability of images from different sources allows for thegeneration of 3D environments for a large collection of images. As aresult, the 3D environment may be difficult to share between users.Additionally, a large number of images may cause the scene to becluttered, detracting from the user experience. Further, users may wantto provide a more structured experience than that provided by generalnavigation tools that allow users to freely navigate the 3D environment.For example, users may wish to use the environment to tell stories, givetours, or otherwise provide a more structured way of viewing.

Accordingly, in an embodiment of the present invention, users may createdocuments that may be readily shared, viewed, and edited. Instead ofcontaining the content itself, the document includes references tounderlying content, which includes a 3D environment with imagespositioned therein. The references may include only a subset of theimages within the 3D environment. Additionally, the document definesconnections between the images. The connections between images representa path or set of paths through the 3D environment and images. In oneembodiment, this may be a linear path through the 3D environment from astarting point to an ending point. In another embodiment, this may bemultiple paths with decision points connecting the various paths,creating a grid-like environment that may be traversed by a viewer. Theconnections between images are primarily spatial, but may also be basedon other dimensions, such as subject, contents, time, and author.Additionally, the connections may be created automatically by the systemusing some heuristics, or can be authored manually by a user.

In addition to connections between images that represent paths through a3D environment, the document may include links to other types ofcontent, such as annotations, audio narration, and ambient audio. Insome cases, these other content types may be associated directly with aparticular image. For example, an audio narration describing an objectin an image may be linked to that image. In other cases, these othercontent types may be associated with connections between images or maysimply exist in the document. For example, an object may be shown usinga number of photographs taken from different angles and viewpoints. Anaudio narration discussing the object could be linked to this series ofphotographs. As another example, users may wish to include ambient audiorecorded from the location the 3D environment represents. Instead ofbeing linked to a particular image or set of images, the ambient audiomay simply be repeated throughout the viewing experience.

In some embodiments, multiple people may work to create and/or edit adocument in a collaborative way. For example, users may collaborate totell a story of an event set in a particular location or to create acompelling advertisement for a shopping complex. Such a collaborativeauthoring process may be Wiki-like. There may be an overall owner of thedocument, but other users may edit it. A history of edits is preservedso that corrections may easily be made.

Turning to FIG. 3, a flow diagram is provided illustrating an exemplarymethod 300 for creating a document in accordance with an embodiment ofthe present invention. As shown at block 302, images within a 3Denvironment are selected and references to the images are includedwithin the document. As indicated previously, a 3D environment mayinclude too many images to provide a satisfying user experience.Accordingly, only a subset of the images may be selected for thedocument.

As shown at block 304, connections between images are identified.Typically, the connections are based on spatial relationships betweenimages, such as images showing different perspectives of a common objector images that show adjacent objects within the 3D environment. In somecases, the connections may be based on other dimensions, such assubject, contents, time, and author.

One or more paths through the 3D environment are defined based on theconnections between images, as shown at block 306. As indicated above,this may include a single, linear path through the 3D environment or mayinclude a number of paths connected by one or more decision points.

Other types of content may also be associated with the document, asshown at block 308. These other types of content may include contentadded by users, for example, to tell a story, provide a tour, or tootherwise provide a richer experience. For example, the content mayinclude annotations, audio narration, and ambient audio.

User Viewing Patterns

Information regarding user viewing patterns, such as how users navigateand view images within a 3D environment, may be useful to provide a moresatisfying user experience. For instance, in an embodiment of thepresent invention, images within a 3D environment may be ranked based onuser viewing information, such as the number of users who have viewed aparticular image and/or how long users have viewed the image (i.e., adwell time). By ranking images, images that are more representative,pleasing, and/or interesting to users may be identified. This isparticularly useful when thousands or even millions of images may beavailable for a given 3D environment, causing clutter within the 3Denvironment. To reduce image clutter, higher ranking images may beselected for presentation, while lower ranking images may be removed. Insome embodiments, to prevent a sort of self-fulfilling prophecy in whichhigher ranking images are arbitrarily maintained at a higher ranking dueto their continued presentation, some lower ranking images may beselected and included for presentation. This provides an opportunity forlower ranking images (e.g., images that are newly added to the 3Denvironment) to establish a higher ranking. As a result, the system canaccurately reflect what is trying to be measured, which is users'preferences. In addition to selecting images, image rankings may be usedto automatically identify connections between images.

Referring to FIG. 4, a flow diagram is provided showing an exemplarymethod 400 for ranking images in accordance with an embodiment of thepresent invention. As shown at block 402, user viewing information for anumber of images is received. As indicated previously, the user viewinginformation for each image may include information such as the number ofusers who have viewed a particular image and the amount of time theimage was viewed. As shown at block 404, the images may be ranked basedon the user viewing information.

Image rankings may be particularly useful for the automatic creation andediting of documents described hereinabove. In particular, imagerankings determined from user viewing patterns within a 3D environmentmay be used to generate a document by automatically selecting images andpaths through the 3D environment. Additionally, image rankings may bedetermined for a particular document by analyzing user viewing patternsof the document. These image rankings may be used to further refine thedocument by identifying user preferences for images and paths.

In addition to user viewing information associated with each image, usernavigational information may be collected for a 3D environment and usedto provide a better user experience. The user navigational informationmay include information regarding paths taken by users through a 3Denvironment. As such, the user navigational information may allow forthe automatic identification of connections between images, as well asthe selection of paths through the 3D environment, for example, forautomatically generating tours as described hereinabove.

Analysis of Image Spatial Density

In another embodiment of the present invention, the spatial density ofimages within a 3D environment may be analyzed and a variety ofapplications employing such spatial density information may be realized.In particular, the spatial density of images within a 3D environmentprovide information regarding what people are looking at in the realworld that the 3D environment represents. Additionally, the spatialdensity of images provides information regarding the movement patternsof people through the real world. Accordingly, by analyzing the spatialdensity of images within a 3D environment, points of interest to usersand paths traveled by users may be identified.

A flow diagram showing an exemplary method 500 for using spatial densityinformation to determine points of user interest is provided in FIG. 5.As shown at block 502, a 3D environment is provided having a pluralityof images positioned therein based on spatial density informationassociated with each of the images. Points of interest are thendetermined by analyzing the spatial density of the images within the 3Denvironment, as shown at block 504.

One application of such spatial density information is to enhance userexperiences within a 3D environment. For instance, spatial densityinformation may be used to winnow down images to prevent excessiveclutter that may result from an excessive number of available images fora particular 3D environment. Additionally, spatial density informationmay be used to automatically select paths through the 3D environment,for example, for the creation of tours through a 3D environment. Thismay provide more pleasing stories or tours and more immersiveexperiences.

A variety of real world applications may also be realized by employingspatial density information for images within a 3D representation. Forexample, spatial density information may be used to: determineplacements of advertising in the real world; set advertisement pricing,rent amounts, and real estate pricing; build up advertising along oftentraveled routes, optimize pedestrian traffic planning, and to tailorreal world tours. One skilled in the art will recognize that many otherreal world applications may be realized from spatial density informationcollected from a 3D representation of the real world in accordance withembodiments of the invention.

Navigating Between Images in Webpages and 3D Environments

In yet another embodiment of the invention, webpages may be seamlesslylinked to points of interest in 3D space allowing users to navigatebetween webpages and 3D environments. In particular, users may “diveinto” 3D environments from images on webpages. Conversely, users may“dive out of” 3D environments to webpages. Combining these aspects withthe ability to navigate among different images in a 3D environmentprovides a new approach for users to navigate between webpages. Forexample, a user may “dive into” a 3D environment from an image in afirst webpage. The user may then navigate to another image in the 3Denvironment, and use that image to “dive out of” the 3D environment to asecond webpage containing that image.

Referring to FIG. 6, a flow diagram is provided illustrating anexemplary method 600 for navigating between a webpage and a 3Denvironment in accordance with an embodiment of the present invention.FIG. 6 illustrates the concept of “diving into” a 3D environment from animage in a webpage, as well as “diving out of” the 3D environment to thesame or another webpage. Initially, as shown at block 602, a user mayaccess a webpage having an image. The image includes a hyperlink to a 3Denvironment, which includes that image, as well as other images,positioned within the 3D environment based on spatial informationassociated with each image. As shown at block 604, the user selects theimage within the webpage. In response to the user selection, the user isnavigated from the webpage to the 3D environment, as shown at block 606.In some embodiments, the 3D environment is presented from a positionwithin the 3D environment based on the spatial information associatedwith the image that was in the webpage. In other words, the 3Denvironment is presented from the viewpoint of that image.

After “diving into” the 3D environment, the user may choose to navigatethrough the 3D environment and view other images. Some of the imageswithin the 3D environment may include hyperlinks to webpages in whichthe images are located. As shown at block 608, the user navigates to anew image in the 3D environment. The new image includes a hyperlink toanother webpage. As shown at block 610, the user selects the image inthe 3D environment. By selecting the image, the user is navigated fromthe 3D environment to a webpage containing that new image, as shown atblock 612.

By way of an example, a user may access a friend's webpage that includesa discussion of the friend's trip to Paris. The webpage may also includea number of photographs taken by the friend during the trip, including aphotograph of the front of the Notre Dame cathedral. The photograph hasbeen located within a 3D environment of the Notre Dame cathedral, suchas that shown in FIG. 2B, and includes a hyperlink to that 3Denvironment. When the user selects the image, the user is navigated tothe 3D environment, which is presented from the viewpoint of thephotograph from the friend's webpage. The user may then choose tonavigate through the 3D environment and view other images of the NotreDame cathedral. Some of these images may have hyperlinks to webpagesthat contain the respective images. For instance, the user may navigateto an image, which comprises a close-up photograph of the central frontdoor to the cathedral. The photograph may include a hyperlink to atourism webpage that includes the photograph. By selecting thephotograph, the user is navigated from the 3D environment to the tourismwebpage.

Navigating between Aerial Imagery and 3D Environments

A variety of web sites, such as TerraServer, Virtual Earth, and GoogleMaps, are available that allow users to navigate aerial photographs. Thewebsites allow users to view aerial photographs of different regions ofthe world, as well as to zoom between higher and lower level aerialimages. However, users may be dissatisfied when the lowest level aerialphotographs do not provide sufficient detail. In particular, users mayalso wish to view and navigate through street-level images.

Another embodiment of the invention provides an improved user experienceby allowing users to navigate from aerial photographs to 3D environmentsthat have been generated from and include 2D terrestrial images.Accordingly, users may be able to fly continuously from high levelaerial photographs to a street-level experience. As a user navigatesfrom high level aerial photographs to lower level aerial photographs, alevel may be reached in which the user is seamlessly transitioned froman aerial photograph to a 3D environment containing a variety of 2Dterrestrial images of the area. The user may then navigate through the3D environment and also transition from the 3D terrestrial environmentto the aerial photographs.

Interior Space 3D Environments

In addition to 3D environments for outdoor spaces and scenes, 3Denvironments of interior spaces may also be generated and navigatedusing 2D images of the interior spaces. Such 3D environments of interiorspaces present a new form of virtual tours that may be provided for realestate, apartments, and businesses, such as restaurants, stores, andmuseums, for example. Allowing users to navigate through 3D environmentsof interior spaces using 2D images of the spaces presents a variety ofpossibilities, such as for selling real estate, advertising rentalproperties, or marketing a business.

Additionally, 3D environments of outdoor spaces may be connecteddirectly with 3D environments of interior spaces. Images within a 3Denvironment of an outdoor space could be used as an entry point to a 3Denvironment for an interior space. As an example, a 3D environment couldbe generated of an area having a number of shops and restaurants. The 3Denvironment could allow a user to navigate through images of the areaand select an image linked to a 3D environment of an interior of one ofthe shops or restaurants. The image could include a doorway to arestaurant, for example, that when selected transitions from the 3Denvironment for the outdoor space to the 3D environment for therestaurant. The user could then navigate through the 3D environment forthe restaurant.

Facilitating Searching

There are numerous possibilities for linking geographic searches to 3Denvironments. Direct semantic connections among webpages can also beinferred when they include photographs taken from (or of) nearbylocations; for both search and navigation purposes, this can be thoughtof almost as a hyperlink.

An additional implication is that photographs become the catalyst forcreating semantic connections—something the Web has been trying to dofor some years. This is not so surprising considering the density ofinformation in an image. Although today images are mostly opaque,advances in object recognition/categorization in conjunction with thistechnology will unlock some of that data, while at the same timepreserving connections between images.

The advent of searching as the primary means of navigating to a webpagealtered the way content was authored (most infamously, with hiddenkeyword pages). Similarly, although many of the web-photo hybridpossibilities summarized above can be enabled in the browser without anyspecial content authoring or change in the web ecosystem, new authoringmodalities are likely to emerge, in which the “linkable” nature ofimages is exploited to create portals and connect environments.

Live Feeds and Real-Time/Near Real-Time Images

Live cell phone and web-cam images and video streams could also beintegrated into 3D environments as live elements. Potential applicationsinclude live news gathering, reviewing concert footage from multiplevantage points, sharing wedding photos, enhancing the effectiveness ofwatchdog organizations such as World Watch, and empowering children indeveloping countries with cameras.

Creation of 3D Environments for 3D Objects

Another application of this technology is in the visual exploration of3D objects, especially objects that might be of interest to collectors,aficionados, or for Web-based sales. Automatically building high-quality3D models from images has proven to be a challenging problem that is notyet adequately solved. Photograph tours of objects in accordance withembodiments might bridge the gap between random collections ofphotographs and true 3D models with an experience that is intuitive andvisually appealing.

CONCLUSION

As can be understood, embodiments of the present invention provideapplications that extend the basic concept of generating 3D environmentsfrom 2D images and allowing user to navigate the 3D environments. Thepresent invention has been described in relation to particularembodiments, which are intended in all respects to be illustrativerather than restrictive. Alternative embodiments will become apparent tothose of ordinary skill in the art to which the present inventionpertains without departing from its scope.

From the foregoing, it will be seen that this invention is one welladapted to attain all the ends and objects set forth above, togetherwith other advantages which are obvious and inherent to the system andmethod. It will be understood that certain features and subcombinationsare of utility and may be employed without reference to other featuresand subcombinations. This is contemplated by and is within the scope ofthe claims.

What is claimed is:
 1. A computer-implemented method being performed byone or more computing devices including at least one processor, forranking images, the method comprising: receiving user viewinginformation associated with each of a plurality of images of ageographically contiguous area, the plurality of images being acollection of photographs obtained from a variety of sources includingat least one person, the geographically contiguous area representing ascene comprising adjacent objects or different perspectives of a commonobject in the real world, each of the images being automaticallypositioned in a three-dimensional (3D) environment based on spatialinformation corresponding to the geographically contiguous area andderived from each of the images, the 3D environment comprising a 3Dmodel having been automatically generated from the plurality of imagesand representing a model of the real world scene; and ranking at least aportion of the plurality of images based on the user viewing informationassociated with users viewing the images within the 3D environment toprovide one or more image rankings.
 2. The method of claim 1, whereinthe user viewing information for an image includes informationassociated with at least one of the following: a number of users whohave viewed the image; and a user dwell time for the image indicatinghow long a user has viewed the image.
 3. The method of claim 1, furthercomprising controlling presentation of at least a subset of theplurality of images based on the one or more image rankings.
 4. Themethod of claim 3, wherein controlling presentation of at least a subsetof the plurality of images based on the one or more image rankingsincludes selecting a subset of higher ranking images for presentationand removing from presentation a subset of lower ranking images.
 5. Themethod of claim 4, further comprising periodically selecting one or moreimages from the subset of lower ranking images for presentation.
 6. Themethod of claim 1, further comprising automatically defining one or moreconnections between images based on the one or more image rankings. 7.The method of claim 1, further comprising receiving user navigationinformation associated with user navigations through the 3D environment.8. The method of claim 7, wherein the user navigation informationincludes information regarding paths taken by users when navigatingthrough the 3D environment, the paths representative of images usershave viewed in the 3D environment and an order in which the images wereviewed.
 9. A computer-implemented method being performed by one or morecomputing devices including at least one processor, for using images todetermine points of user interest, the method comprising: providing athree-dimensional (3D) environment having a plurality of images of ageographically contiguous area in the real world, the plurality ofimages being a collection of photographs obtained from a variety ofsources including at least one person, the geographically contiguousarea representing a scene comprising adjacent objects or differentperspectives of a common object in the real world, wherein the 3Denvironment comprises a 3D model that is automatically generated basedon the plurality of images and represents a model of the real worldscene, each of the images being automatically positioned in the 3Denvironment based on spatial information corresponding to thegeographically contiguous area and derived from each of the images; anddetermining points of user interest in the geographically contiguousarea in the real world by analyzing the spatial density of the imageswithin the 3D environment.
 10. The method of claim 9, further comprisingcontrolling the presentation of images based on the spatial density ofthe images within the 3D environment.
 11. The method of claim 10,wherein controlling presentation of images based on the spatial densityof the images within the 3D environment comprises selecting a firstsubset of images for presentation and removing from presentation asecond subset of images.
 12. The method of claim 9, further comprisingdetermining connections between images based on the spatial density ofthe images within the 3D environment.
 13. The method of claim 9, furthercomprising determining paths traveled by individuals in thegeographically contiguous area in the real world by analyzing thespatial density of the images within the 3D environment.
 14. One or morecomputing devices having at least one processor and one or morecomputer-readable media, the one or more computing devices comprising: athree-dimensional (3D) environment generating component that generates a3D environment from a plurality of images of a geographically contiguousarea in the real world, the plurality of images being a collection ofphotographs obtained from a variety of sources including at least oneperson, the geographically contiguous area representing a scenecomprising adjacent objects or different perspectives of a common objectin the real world, the 3D environment comprising a 3D model representinga model of the real world scene generated from the plurality of images,wherein the 3D environment generating component positions each image ofat least a portion of the plurality of images within the 3D environmentbased on spatial information corresponding to the geographicallycontiguous area and derived from each image to organize the photographsspatially and create transitions between them that preserve theirgeometric relationships; and an analysis component that analyzesinformation regarding images located within the 3D environment.
 15. Theone or more computing devices of claim 14, wherein the analysiscomponent includes means for analyzing user viewing informationassociated with users viewing images within the 3D environment.
 16. Theone or more computing devices of claim 15, wherein the user viewinginformation for an image includes information associated with at leastone of the following: a number of users who have viewed the image; and auser dwell time for the image indicating how long a user has viewed theimage.
 17. The one or more computing devices of claim 15, wherein theanalysis component further comprises means for controlling presentationof at least a subset of the plurality of images based on the userviewing information.
 18. The one or more computing devices of claim 14,wherein the analysis component includes means for analyzing spatialdensity information corresponding with the spatial density of imageswithin the 3D environment.
 19. The one or more computing devices ofclaim 18, wherein analyzing the spatial density information includesdetermining points of user interest in the geographically contiguousarea in the real world by analyzing the spatial density of images withinthe 3D environment.
 20. The one or more computing devices of claim 18,wherein analyzing the spatial density information includes determiningpaths traveled by individuals in the geographically contiguous area inthe real world by analyzing the spatial density of images within the 3Denvironment.